chore(genai,vertexai,community): Making integration tests async #960 #1368
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 5 commits
November 20, 2025 00:38
- Add pytest-xdist>=3.8.0,<4.0.0 to test dependencies in genai and community packages - Update Makefiles to use -n auto flag for parallel test execution - This enables faster integration test runs using multiple workers
- Convert all synchronous integration tests to async in genai package - Update test_chat_models.py: 20+ tests converted to async - Update test_llms.py: all tests converted to async - Update test_embeddings.py: all tests converted to async - Update test_callbacks.py: streaming callback test converted to async - Update test_tools.py: tool tests converted to async - Update test_function_call.py: all function call tests converted to async - This enables parallel test execution with pytest-xdist for improved performance
- Convert all synchronous integration tests to async in vertexai package - Update test_chat_models.py: 37+ tests converted to async - Update test_llms.py: all tests converted to async - Update test_embeddings.py: all tests converted to async - Update test_callbacks.py: all callback tests converted to async - Update test_chains.py: all chain tests converted to async - Update test_evaluation.py: all evaluation tests converted to async - Add aevaluate() method to VertexStringEvaluator class for async batch evaluation - Update test_llms_safety.py: safety tests converted to async - Update test_maas.py: MaaS model tests converted to async - Update test_model_garden.py: all model garden tests converted to async - Update test_vision_models.py: vision model tests converted to async - Update test_vectorstores.py: vector store tests converted to async - Update test_anthropic_files.py: Anthropic file tests converted to async - This enables parallel test execution with pytest-xdist for improved performance
- Convert synchronous integration tests to async in community package - Update test_check_grounding.py: grounding check test converted to async - Update test_rank.py: ranking retriever test converted to async - This enables parallel test execution with pytest-xdist for improved performance
RishikaGhosh
changed the title
RishikaGhosh
changed the title
RishikaGhosh
changed the title
RishikaGhosh
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Converts all synchronous integration tests to asynchronous tests across the langchain-google repository to enable parallel test execution with pytest-xdist.
Fixes #960
Changes Made
Infrastructure
pytest-xdist>=3.8.0,<4.0.0to test dependencies in genai and community packages-n autoflag for parallel test executionTest Conversions
Genai Package (~20+ tests)
test_tools.py: Tool teststest_function_call.py: Function call testsVertexai Package (~30+ tests)
Community Package (2 tests)
Testing
All tests have been converted following the async pattern:
def test_...→async def test_....invoke()→await .ainvoke().generate()→await .agenerate().stream()→async for .astream()Benefits
pytest-xdist